Head-mounted face image capturing devices and systems

ABSTRACT

The present invention provides head-mounted systems and devices for capturing an image of a user&#39;s face. In particular, the present invention provides systems and devices comprising: a) a head-mounted frame component configured to be mounted on the head of a user (e.g., hat, head band, glasses, goggles, etc.) and b) an extending component that is moveable between a first position in or adjacent to the head-mounted frame component and a second position non-adjacent to the head-mounted frame component that allows a camera (or mirror) on the extending component to capture an image (e.g., picture or video) of the user&#39;s face.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present invention claims the priority of U.S. Provisional PatentApplication Ser. No. 61/439,177, filed Feb. 3, 2011, which isincorporated by reference in its entirety.

FIELD OF THE INVENTION

The present invention provides head-mounted systems and devices forcapturing an image of a user's face. In particular, the presentinvention provides systems and devices comprising: a) a head-mountedframe component configured to be mounted on the head of a user (e.g.,hat, head band, glasses, goggles, etc.) and b) an extending componentthat is moveable between a first position in or adjacent to thehead-mounted frame component and a second position non-adjacent to thehead-mounted frame component that allows a camera (or mirror) on theextending component to capture an image (e.g., picture or video) of theuser's face.

BACKGROUND

Video conferencing is becoming an important way for people andbusinesses to communicate. However, challenges to mobile videoconferencing remain, for example, many devices require the user to holdtheir phone in front of their face to capture an image of their face.What is needed are devices and systems that allow hands-free mobilevideo conferencing.

SUMMARY OF THE INVENTION

The present invention provides head-mounted systems and devices forcapturing an image of a user's face. In particular, the presentinvention provides systems and devices comprising: a) a head-mountedframe component configured to be mounted on, or attached to, the head ofa user (e.g., hat, head band, glasses, goggles, etc.) and b) anextending component that is moveable between a first position in oradjacent to the head-mounted frame component and a second positionnon-adjacent to the head-mounted frame component that allows a camera(or mirror reflecting to a camera mounted on the frame component) on theextending component to capture an image (e.g., picture or video) of theuser's face.

In certain embodiments, the present invention provides head-mountedsystems and devices for capturing an image of a user's face. Inparticular, the present invention provides systems and devicescomprising: a) a head-mounted frame component configured to be mountedon, or attached to, the head of a user (e.g., hat, head band, glasses,goggles, etc.), and b) an extending component that is moveable between afirst position in which a distal end of said extending component isadjacent to the head-mounted frame component and a second position inwhich the distal end is non-adjacent to the head-mounted framecomponent, wherein a camera is mounted on said head-mounted framecomponent and is directed toward the distal end of the extendingcomponent when in the non-adjacent position, wherein the distal end ofthe extending component comprises an optical element (e.g., lens,mirror, etc.) that reflects and/or redirects light thereby allowing thecamera on the head-mounted frame component to capture an image (e.g.,picture or video) of the user's face.

In some embodiments, systems and devices are provided comprising: a) ahead-mounted frame component configured to be mounted on, or attachedto, the head of a user (e.g., glasses, goggles, etc.) and b) anextending component that is moveable between a first position in oradjacent to the head-mounted frame component and a second positionnon-adjacent to the head-mounted frame component that allows a camera onthe extending component to capture an image (e.g., picture or video) ofthe user's face.

In some embodiments, systems and devices are provided comprising: a) ahead-mounted frame component configured to be mounted on, or attachedto, the head of a user (e.g., hat, head band, glasses, goggles, etc.),wherein the head-mounted frame component comprises a camera and b) anextending component that is moveable between a first position in oradjacent to the head-mounted frame component and a second positionnon-adjacent to the head-mounted frame component, wherein the extendingcomponent comprises an optical element (e.g., mirror or lens) thatallows a camera on the head-mounted frame component directed toward theoptical element in the position non-adjacent to the head-mounted framecomponent to capture an image (e.g., picture or video) of the user'sface.

In certain embodiments, the present invention provides systems anddevices for capturing an image of a user's face comprising: a) ahead-mounted frame component configured to be attached to, or mountedon, the head of a user; and b) an extending component connected to thehead-mounted frame component, wherein the extending component comprises;i) a main rod, ii) a housing component attached to the main rod, iii) acamera located in or attached to the housing component; wherein theextending component is moveable between a first position in or adjacentto the head-mounted frame component, and a second position non-adjacentto the head-mounted frame component, wherein the second position allowsthe camera to capture an image of the user's face when the head-mountedframe component is attached to the head of the user.

In other embodiments, the present invention provides systems and devicesfor capturing an image of a user's face comprising: a) a head-mountedframe component configured to be attached to, or mounted on, the head ofa user, wherein the head-mounted frame component comprises a camera; andb) an extending component connected to the head-mounted frame component,wherein the extending component comprises; i) a main rod, ii) a housingcomponent attached to the main rod, iii) a optical element (e.g. mirror,lens, etc.) located in or attached to the housing component; wherein theextending component is moveable between a first position in or adjacentto the head-mounted frame component, and a second position non-adjacentto the head-mounted frame component, wherein the second position allowsthe camera to capture an image of the user's face via reflection orredirection of the image off the optical elements, when the head-mountedframe component is attached to the head of the user.

In other embodiments, the systems and devices further comprise a housingcomponent hinge, wherein the housing component is attached to the mainrod via the housing component hinge. In certain embodiments, the mainrod comprises a camera casing recess configured to allow the housingcomponent and camera to pivot therein via the housing component hinge.In some embodiments, in the first position, the camera points outwardfrom the head-mounted frame component and can capture what the user isseeing, and wherein in the second position, the camera can capture animage of the user's face.

In particular embodiments, the systems and devices further comprise atleast one lens (e.g., 1, 2, or more), wherein the at least one lens isattached to the head-mounted frame component, and is configured to atleast partially cover the user's eye when the device is mounted on theuser's head. In some embodiments, the system or devices further comprisea projection device (e.g., a Light-guide Optical Element (LOE) fromLUMUS or similar device) configured to project an image onto or into theat least one lens such that it can be seen by the user.

In some embodiments, the second position places the camera at least 4inches away from the user's face (e.g., 4 inches, 4.5 inches, 5 inches,5.5 inches, 6 inches, 6.5 inches, 7 inches, or more). In otherembodiments, the extending component is hingedly connected to thehead-mounted frame component. In other embodiments, the head-mountedframe component comprises a left frame arm and a right frame arm. Insome embodiments, the first position is within the right frame arm(e.g., as shown in FIG. 11). In particular embodiments, the left or theright frame arm comprises a frame arm compartment (e.g., for batteries,CPU, electronics, etc.). In some embodiments, the left or the rightframe arm comprises a speaker configured to direct sound to the user'sear.

In certain embodiments, the systems and devices further comprise a lightand/or microphone located on the main rod adjacent to the camera. Inother embodiments, the camera comprises a wide-angle lens. In particularembodiments, the camera comprises a web-cam. In additional embodiments,the head-mounted frame component comprises a main rod frame recess. Inparticular embodiments, the first position is within the main rod framerecess. In other embodiments, the systems and devices further comprise atelescoping internal rod that is configured to extend from within themain rod. In other embodiments, the systems and devices further compriseat least one eye tracking device configured to track eye movement and/orblinks. In further embodiments, the at least one eye tracking device isan infrared eye tracking device.

In some embodiments, the systems and devices further comprise acommunication element. In some embodiments, a communication element isconfigured to wirelessly transmit images of said user (and/or otherdata), and/or receive data from an outside source. In some embodiments,a communication element is mounted on or within the head-mounted frame.In some embodiments, a communication element is configured to transmitand/or receive information (e.g., to a satellite, to a processor, etc.).In some embodiments, a communication element transmits images (or datarelated thereto) collected from the camera. In some embodiments, acommunication element receives data, information, signals, and/orimages, from a processor, satellite, another user, and/or a serviceprovider. In some embodiments, a communication element transmits and/orreceives communication via Bluetooth, WI-Fi, cellular, 3G, 4G, etc.

In certain embodiments, the systems and devices of the present inventionallow an image of a user's face to be projected into a video game (e.g.,to serve as a true-life avatar in a video game). In particularembodiments, the devices and systems are linked to a video game (e.g.,similar to XBOX KINNECTS) such that the camera captures an image of theuser wearing the device and projects this as the face of the video gamecharacter in the game that is being played by the user. In someembodiments, the image of the user's face is enhanced, such as to makeit consistent with the video game (e.g., warrior paint, older, younger,etc.) or to make the image of the face objectively better looking Incertain embodiments, the systems and devices further comprise acommunication element, wherein said communication element is configuredto wirelessly transmit images of said user and/or receive data from avideo game console or gaming computer (e.g., XBOX, WII, PLAYSTATION,etc.). In particular embodiments, the video game console or gamingcomputer processes the images captured by the camera and processes themas the face of the character in the video game.

DESCRIPTION OF THE FIGURES

FIG. 1 shows an exemplary embodiment of a face-capturing device orsystem of the present invention, including a head-mounted framecomponent (80) and an extending component composed of a main rod (10),housing component (20) and camera (40, not shown) that is attached by ahinge (50) to the head mounted frame component (80). Also shown is amain rod recess (30) that can house the main rod (10) when it is in the“closed” position.

FIG. 2 shows an exemplary embodiment of the housing component (20)attached to the end of main rod (10), where the camera (40) is locatedin the housing component (20). Also shown is part (100) which may be alight or a microphone.

FIG. 3 shows a cross-section through 3-3 in FIG. 1, and shows how themain rod (10) can pivot on the hinge (50).

FIG. 4 shows a cross-section through 3-3 in FIG. 1, and shows how themain rod (10) can pivot on the hinge (50), where the hinge is differentfrom that shown in FIG. 3.

FIG. 5 shows a cross-section through 3-3 in FIG. 1, and shows how themain rod (10) can pivot on the hinge (50), where the hinge is differentfrom that shown in FIGS. 3 and 4.

FIG. 6 shows an exemplary embodiment of a face-capturing device orsystem of the present invention. This figure shows left frame arm (81)and right frame arm (82), where the right frame arm includes a speaker(150) for projecting sound into a user's ear (e.g., from a videoconference). This figure also shows how the housing component can behingedly attached to the main rod such that the camera can pivot out.

FIG. 7 shows the circled area from FIG. 6 and specifically shows acamera casing recess (120) that allows the camera (40) to move from aposition in the casing recess to a position outside the recess thatpoints back towards the user's face.

FIG. 8 shows the face-capturing device of FIG. 6 where the main rod (10)is folded back into the main rod recess (30) such that it is flush withthe head-mounted frame component (80). The housing component, housingthe camera, is folded back into the camera casing recess (120) such thatthe camera (40) looks outward from the user's face (e.g., so the cameracan be used to capture what the user is seeing, rather than capturing animage of the user's face).

FIG. 9 shows an embodiment of the face-capturing device or system of thepresent invention where the main rod (10) contains a telescopinginternal rod (60) that can slide out of the main rod, thus extending thedistance of the housing component (containing the camera) from theuser's face.

FIG. 10 shows an exemplary embodiment of a face-capturing device orsystem of the present invention on the head of a user. The camera (40)captures an image of a user's face, which can then be transmitted (e.g.,over the internet or cellular network) to another person (e.g., for avideo conference). In this embodiment, the face of the other person isprojected onto or into one of the lens shown for a true face to facevideo conference.

FIG. 11 shows an exemplary embodiment of a face-capturing device orsystem of the present invention where the main rod (10) is moveable froma position mostly within the right frame arm to a position where it ismostly outside of the right frame arm.

FIG. 12 shows an exemplary embodiment of a face-capturing device orsystem of the present invention where unidirectional microphones (160)are shown in the frame arms, and left (141) and right (142) eye trackingdevices are shown in the head-mounted frame component.

DESCRIPTION OF THE INVENTION

The present invention provides head-mounted systems and devices forcapturing an image of a user's face. In particular, the presentinvention provides systems and devices comprising: a) a head-mountedframe component configured to be mounted on the head of a user (e.g.,hat, head band, glasses, goggles, etc.) and b) an extending componentthat is moveable between a first position in or adjacent to thehead-mounted frame component and a second position non-adjacent to thehead-mounted frame component that allows a camera on the extendingcomponent to capture an image (e.g., picture or video) of the user'sface.

FIG. 1 shows an exemplary embodiment of a face-capturing device orsystem of the present invention, including a head-mounted framecomponent (80) (e.g., that includes a lens frame (83) that holds lensesfor glasses or goggles) and an extending component composed of a mainrod (10), housing component (20) and camera (40, not shown, as it islooking back at the user) that is attached by a hinge (50) to the headmounted frame component (80). Also shown is a main rod recess (30) thatcan house the main rod (10) when it is in the “closed” position. Themain rod is configured to pivot (e.g., on the hinge) so that it can befolded back adjacent to the head-mounted frame component, or within therecess (30) in the head-mounted frame component. The main rod (10) canthen extend outward to a point that is away from the head-mounted framecomponent (and therefore away from a user's face who is wearing thedevice or system). In the extended position, the camera that is in thehousing component (20) can capture a picture or video of the user'sface. Preferably, the head-mounted frame component is attached to a leftframe arm (81) (that goes over a user's left ear) and a right frame arm(82) (that goes over the user's right ear), in order to secure thedevice to a user's head. In certain embodiments, the right frame armcontains a frame arm compartment (110) that can be used, for example, tohold batteries, Bluetooth electronics, a CPU, wiring for the camera andother components, etc.). Also shown in FIG. 1 is a wire (90) that runsfrom the camera (e.g., web cam), or from light, or from microphone, backtoward the head-mounted frame component (e.g., to attach to a CPU, orbatteries, or Bluetooth connection, etc.). Attaching or includingcomponents such as microphones, CPUs, batteries, etc. to glasses orgoggles is known in the art. For example TRISPECS glasses incorporatemany of these features (see, e.g., U.S. Pat. Pub. 2010/0045928, which isherein incorporated by reference in its entirety).

In some embodiments, the camera (40) is too close to the user's facesuch that a distorted facial image is generated. In some embodiments,the distortion of the facial image is corrected by optical (e.g., lens)and/or digital (e.g., facial image software) means. In such embodiments,the facial image software (e.g., by a CPU in the device or hosted in theinternet) is used to correct the facial image prior to sending toanother party. Distortion correction software is well known in the art(see, e.g., Biwasaka et al., Forensic Science International, 197(1):97-104, 2010; and Biwasaka et al., “Assessment of ComputerizedMethod for Correction of Optical Distortion of Facial Images,” JapaneseJournal of Forensic Science and Technology Vol. 13 (2008), No. 1 pp.7-16, both of which are herein incorporated by reference). In someembodiments, software from ALTOSTORM SOFTWARE or IMMERVISION isemployed, although any type of suitable commercial software can beemployed.

FIG. 2 shows an exemplary embodiment of the housing component (20)attached to the end of main rod (10), where the camera (40) is locatedin the housing component (20). It is noted that, in some embodiments,part (40) is instead a mirror (or other optical device) that reflectsthe image of the user's face back to a camera that is located on theframe component (80), where the camera is focused on the mirror (orother optical component). In such embodiments, the distance from theframe mounted camera to the mirror and back to the user's face allows awider view of the user's face given the distance that the image has totravel.

Also shown in FIG. 2 is part (100) which may be a light, microphone, orother sensor (e.g., temperature sensor, gyroscope, etc.). In certainembodiments, the camera is a wide-angle camera or a web-cam, or awide-angle web cam. In certain embodiments, part (100) is a microphoneconfigured to pick up the voice of the user (e.g., when the user ismaking a phone call or video call). In particular embodiments, part(100) is a light (visible light or infrared light) that is used toilluminate the user's face such that it can be clearly picked up by thecamera (e.g., for a video conference).

FIGS. 3, 4, and 5 show a cross-section through 3-3 in FIG. 1, and showhow the main rod (10) can pivot on the hinge (50), where the hinge canbe any type of suitable hinge, such as those shown in these figures.

FIG. 6 shows an exemplary embodiment of a face-capturing device orsystem of the present invention. This figure shows left frame arm (81)and right frame arm (82), where the right frame arm includes a speaker(150) for projecting sound into a user's ear (e.g., from a videoconference). The speaker (150) can be flush (as shown) or can bulge outsuch that the speaker is physically aimed at the user's ear. This figurealso shows how the housing component can be hingedly attached to themain rod such that the camera can pivot out. Also shown in the leftframe arm is a unidirectional speaker (160) that is aimed toward theuser's mouth such that it can pick up the user's voice during phonecalls or video calls, while largely excluding ambient sound.

FIG. 7 shows the circled area from FIG. 6 and specifically shows acamera casing recess (120) with a hinge (70) that allows the camera (40)to move from a position in the casing recess to a position outside therecess that points back towards the user's face. In such embodiments, ascan be seen in FIG. 7, pivoting of the camera casing (and therefore thecamera) allows a single camera to both capture a user's face (whenextended and pivoted back towards the user's face) and to capture whatthe user is seeing (when the main rod is adjacent to the head-mountedframe component). In some embodiments, a pivoting camera eliminates theneed to have two cameras, as one camera, by pivoting and being tuckedinto a recess, can serve both functions.

FIG. 8 shows the face-capturing device of FIG. 6 where the main rod (10)is folded back into the main rod recess (30) such that it is flush withthe head-mounted frame component (80). The housing component (20),housing the camera (40), is folded back into the camera casing recess(120) such that the camera and casing are flush with the front of theframe and the camera (40) looks outward from the user's face (e.g., sothe camera can be used to capture what the user is seeing). FIG. 8 alsoshows an external microphone (130) for capturing audio (e.g., when thecamera is being used to capture what the user is seeing).

FIG. 9 shows an embodiment of the face-capturing device or system of thepresent invention where the main rod (10) contains a telescopinginternal rod (60) that can slide out of the main rod, thus extending thedistance of the housing component (containing the camera) from theuser's face (e.g., extending the distance from 4-6 inches to 6-10 inchesaway from the user's face). In such embodiments, the need for facialdistortion software correction of a facial image of the user may be lessor non-existent as the camera is farther away from the user's facemaking the likelihood of distortion less.

FIG. 10 shows an exemplary embodiment of a face-capturing device orsystem of the present invention mounted on the head of a user. Thecamera (40) captures an image of a user's face, which can then betransmitted (e.g., over the internet or cellular network) to anotherperson (e.g., for a video conference), to a service provider, and/or toa processor. In this embodiment, the face of the other person isprojected onto or into one of the lens shown for a true face to facevideo conference. Systems and methods for projecting an image (e.g., aperson's face or internet site, or user's email, or over-lay maps, etc.)are known in the art. For example, LUMUS Ltd. (Rehovot, Israel) providesa technology where a digital image is projected into the lens ofglasses. A description of this technology is provided, for example, inU.S. Pat. Pub. 2005/0180687; U.S. Pat. Pub. 2009/0153437; and U.S. Pat.Pub. 2010/0202048; all of which are herein incorporated by reference intheir entireties as if fully set forth herein). In certain embodiments,the devices incorporate this technology or similar technology to allow auser wearing the devices of the present invention to see digital images,such as a person they are on a call with, web pages, email, maps, videogames (e.g., incorporating the user's image (e.g., real-time image)), orother digital content.

FIG. 11 shows an exemplary embodiment of a face-capturing device orsystem of the present invention where the main rod (10) is moveable froma position mostly within the right frame arm to a position where it ismostly outside of the right frame arm.

FIG. 12 shows an exemplary embodiment of a face-capturing device orsystem of the present invention where unidirectional microphones (160)are shown in the frame arms and left (141) and right (142) eye trackingdevices are shown in the head-mounted frame component. Eye-tracking(e.g., infrared eye-tracking) devices are well known in the art and canbe used to control functions, such as a cursor or mouse. For example, auser may have images of a web page projected onto or into one or both oftheir lenses. They can then use eye tracking to control a mouse orcursor or device that monitors gaze time (and/or blinks) to controlinteraction with a computer, such as a web page or email, or othercomputer format. Eye tracking devices and “eye mice” are described inthe following publications: “Eye Tracking Methodology: Theory andPractice,” by Andrew T. Duchowski, 2003; devices from TOBII Technology(Sweden); KOPIN's “GOLDEN-I”; U.S. Pat. Pub. 2007/0164990 “Arrangement,Method and Computer Program for Controlling a Computer Apparatus Basedon Eye-Tracking;” U.S. Pat. Pub. 2009/0125849 “Eye Tracker with VisualFeedback;” U.S. Pat. No. 6,637,883 “Gaze Tracking System and Method;”Krolak and Strumillo, “Eye-blink Controlled Human-Computer Interface forthe Disabled,” Human-Computer Sys. Intera., AISC 60, pgs 123-133, 2009;all of which are herein incorporated by reference as if fully set forthherein.

All publications and patents mentioned in the present application areherein incorporated by reference. Various modification and variation ofthe described methods and compositions of the invention will be apparentto those skilled in the art without departing from the scope and spiritof the invention. Although the invention has been described inconnection with specific preferred embodiments, it should be understoodthat the invention as claimed should not be unduly limited to suchspecific embodiments. Indeed, various modifications of the describedmodes for carrying out the invention that are obvious to those skilledin the relevant fields are intended to be within the scope of thefollowing claims.

1. A device for capturing an image of a user's face comprising: a) ahead-mounted frame component configured to be mounted on the head of auser; and b) an extending component connected to said head-mounted framecomponent, wherein said extending component comprises; i) a main rod,ii) a housing component attached to said main rod, iii) a camera locatedin or attached to said housing component; wherein said extendingcomponent is moveable between a first position in or adjacent to saidhead-mounted frame component, and a second position non-adjacent to saidhead-mounted frame component, wherein said second position allows saidcamera to capture an image of said user's face when said head-mountedframe component is attached to said head of said user.
 2. The device ofclaim 1, further comprising a housing component hinge, wherein saidhousing component is attached to said main rod via said housingcomponent hinge.
 3. The device of claim 2, wherein said main rodcomprises a camera casing recess configured to allow said housingcomponent and camera to pivot therein via said housing component hinge.4. The device of claim 3, wherein, in said first position, said camerapoints outward from said head-mounted frame component and can capturewhat said user is seeing, and wherein in said second position, saidcamera can capture an image of said user's face.
 5. The device of claim1, further comprising at least one lens, wherein said at least one lensis attached to said head-mounted frame component, and is configured toat least partially cover said user's eye when said device is mounted onsaid user's head.
 6. The device of claim 1, further comprising aprojection device configured to project an image onto or into said atleast one lens such that it can be seen by said user.
 7. The device ofclaim 1, wherein said second position places said camera at least 4inches away from said user's face.
 8. The device of claim 1, whereinsaid extending component is hingedly connected to said head-mountedframe component.
 9. The device of claim 1, further comprising at leastone eye tracking device configured to track eye movement and/or blinks.10. The device of claim 9, further comprising a communication element,wherein said communication element is configured to wirelessly transmitimages of said user and/or receive data from an outside source.
 11. Thedevice of claim 10, wherein said communication element is configured totransmit and receive data from a video game console or gaming computer.12. The device of claim 1, wherein said head-mounted frame componentcomprises a left frame arm and a right frame arm, and wherein said leftor said right frame arm comprises a speaker configured to direct soundto said user's ear.
 13. The device of claim 1, further comprising alight or microphone located on said main rod adjacent to said camera.14. The device of claim 1, wherein said camera comprises a wide-anglelens.
 15. The device of claim 1, wherein said camera comprises aweb-cam.
 16. The device of claim 1, wherein said head-mounted framecomponent comprises a main rod frame recess.
 17. The device of claim 16,wherein said first position is within said main rod frame recess. 18.The device of claim 1, further comprising a telescoping internal rodthat is configured to extend from within said main rod.
 19. A system forcapturing an image of a user's face comprising: a) a head-mounted framecomponent configured to be mounted on the head of a user; and b) anextending component connected to said head-mounted frame component,wherein said extending component comprises; i) a main rod, ii) a housingcomponent attached to said main rod, iii) a camera located in orattached to said housing component; wherein said extending component ismoveable between a first position in or adjacent to said head-mountedframe component, and a second position non-adjacent to said head-mountedframe component, wherein said second position allows said camera tocapture an image of said user's face when said head-mounted framecomponent is attached to said head of said user.
 20. A devicecomprising: a) a head-mounted frame component configured to be mountedon, or attached to, the head of a user, and b) an extending componentthat is moveable between a first position in which a distal end of saidextending component is adjacent to said head-mounted frame component anda second position in which the distal end is non-adjacent to saidhead-mounted frame component, wherein a camera is mounted on saidhead-mounted frame component and is directed toward the distal end ofsaid extending component when in the non-adjacent position, and whereinthe distal end of said extending component comprises an optical elementthat reflects and/or redirects light thereby allowing said camera onsaid head-mounted frame component to capture an image of said user'sface.